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We address the problem of applying the Kolmogorov-Sinai 
method of entropic analysis, expressed in a generalized non- 
extensive form, to the dynamics of the logistic map at the 
chaotic threshold, which is known to be characterized by a 
power law rather than exponential sensitivity to initial con- 
ditions. The computer treatment is made difficult, if not im- 
possible, by the multifractal nature of the natural invariant 
distribution: Thus the statistical average is carried out on the 
power index /3. The resulting entropy time evolution becomes 
a smooth and linear function of time with the non-extensive 
index Q < 1 prescribed by the heuristic arguments of ear- 
lier work, thereby showing how to make the correct entropic 
prediction in the spirit of the single-trajectory approach of 
Kolmogorov. 
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The Kolmogorov-Sinai (KS) entropy is attracting 
an increasing interest in the field of chaos since it affords 
a criterion to establish the "thermodynamical" nature of 
a single trajectory in a way independent of the observa- 
tion. This is so because the generating partition results 
in a value of the KS entropy independent of the size of 
the partition cells [|| : A fact of fundamental importance 
to ensure the objective nature of the KS criterion. There 
have been in the recent past some attempts at gen- 
eralizing the KS entropy by replacing the Shannon en- 
tropy, on which the KS is based, with a non-extensive 
form of entropy given by : 
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The attempts at realizing this purpose are stimulated by 
the exponentially increasing interest |0] on this kind of 
non-extensive entropy. The parameter q, which shall be 
referred to as entropix index, has an interesting physical 
meaning. Its departure from the standard value g = 1, 
at which the entropy of Eq. (|l]) recovers the traditional 
Gibbs structure, signals either the existence of long-range 
interactions or of long-time memory. These papers p-p| , 
however, do not explicity evaluate the non-extensive ver- 
sion of the KS entropy. Rather these authors limit them- 
selves to assessing numerically the time evolution of the 
dynamical property 
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where Ax{t) denotes the distance, at time t, between the 
trajectory of interest and a very close auxiliary trajectory. 
The initial distance between the trajectory of interest 
and the auxiliary trajectory, Aa:(0), is made smaller and 
smaller so as to let emerge the kind of sensitivity of the 
dynamics under examination. 

The authors of Refs. |^-^ related the function ^(t) to 
the non-extensive version of the KS entropy with heuris- 
tic arguments. With these arguments they established 
that the analytical form to assign to £^{t) for the non- 
extensive form of the KS entropy to increase linearly is 
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where Aq is a sort of Lyapunov coefhcient. Throughout 
this letter we shall be referring to Q, predicted with en- 
tropic arguments, as true entropic index. In the specific 
case Q < 1, of interest here, Eq. (^) means that the 
distance between the trajectory of interest and the aux- 
iliary trajectory increases as an algebraic power of time. 
However, the numerical calculations made in Refs. |||-||] 
show that the function ^(t) exhibits wild fluctuations, 
although the intensity of these fluctuations fulfills the 
prediction of Eq. (||) . In Ref . @| a theoretical prediction 
was made for the power index /3, and consequently for 
the true entropic index Q = {(3 — 1)//?. This prediction 
reads: 



1 



1 



1 



Q 



(4) 



where amin and ctmax denote the crowding indices corre- 
sponding to the minimum and maximum concentration, 
respectively. 

More recently, the same problem of evaluation of the 
true entropic index Q, resulting in the linear increase of 
entropy as a function of time, was dealt with by the au- 
thors of Ref. [H , by means of the numerical calculation of 
the distribution entropy: The authors of this paper made, 
in fact, the delicate assumption that if a true Q exists, 
making the trajectory entropy increase linearly in time, 
then the same Q makes the distribution entropy increase 
linear in time also. In a sense this letter aims at checking 
this important assumption. This is a challenging prob- 
lem, as the ascertainment of the equivalence of these two 
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distinct entropy forms is the object of discussion also in 
the case of strong chaos 

The problem here under study is that of the calculation 

of 

(5) 

where p{ujq...u>n-i) is the probability of finding the cylin- 
der corresponding to the sequence of symbols loq-'-^n-i 
[0. This entropy expression affords a rigorous way of 
defining the earlier introduced concept of true entropic 
index. If it exists, Q is the value of the entropic index q 
making the entropy of Eq. increase linearly in time. In 
the case q = Q = 1 the limjv-»oo Hq{N)/N becomes the 
ordinary Kolmogorov-Sinai (KS) entropy. In an earlier 
work pi| ] a numerical calculation was made to establish 
Q in the case of a text of only two symbols, with strong 
correlations. The case of many more symbols would be 
beyond the range of the current generation of comput- 
ers. However, when the sequence of symbols is generated 
by dynamics, as in the case here under study, and the 
function £,{t,x) of Eq.(|^) is available (for convenience, 
we make now explicit the dependence on the initial con- 
dition a:;) , it is possible to adopt the prescription of Rcf. 
m, which writes Hq{t) of Eq.(||) as 
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where the symbol t denotes time regarded as a continuous 
variable. In fact, when the condition N » 1 applies, it 
is legitimate to identify N with t. The function p{x) 
denotes the equilibrium distribution density and S the 
size of the partition cells: According to Rcf. [n2| the phase 
space, a one-dimensional interval, has been divided into 
W = 1/S cells of equal size. 

There is now an important remark to make: The non- 
extensive form of KS entropy should read as follows. 
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This apparently means that leaving the ordinary con- 
dition Q — 1 has the unwanted effect of making the 
generalized form of KS entropy dependent on S, thereby 
losing what we consider to be the most attractive as- 
pect of the KS entropy. We are inclined to believe that 
this apparent weakness is, on the contrary, an element 
of strength. We shall see that in the case under discus- 
sion in this letter, due to the multifractal character of 
the natural invariant distribution p{x), the prescription 
of Eq.(0) results in a rate of entropy increase indepen- 
dent of the cell size. In the case of the Manneville map 
Xn+i = Xn + x^, mod 1, it is shown [l5|] that in the 
range 3/2 < z < 2 the stationary correlation function of 
the variable x exists and it is not integrable, thereby sug- 
gesting a possible breakdown of the ordinary KS entropy. 
However, in this case the natural invariant distribution is 



smooth, rather than multifractal, and as a consequence 
of that, the request of the independence of the cell size 
and the adoption of the prescription of Eq. (||) yield the 
condition Q = 1 , in agreement with the conclusions of the 
work of Rcf. . In the case Q = 1 it is straightforward 
to prove that Eq.(0) results in 
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On the other hand, in the ordinary case Eq.(^) becomes 

at,x)^expiX{x)t), (9) 

thereby making Eq.(H) result in the well known Pesin 
relation lldl 
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In conclusion, in the case of a smooth invariant distribu- 
tion, either strongly or weakly chaotic, the prescription 
of Eq. (^ coincides with the Pesin theorem, which allows 
us to replace the direct calculation of the KS entropy 
with the numerically easier problem of evaluating Lya- 
punov coefficients. The case of fractal dynamics implies 
the existence of the true Q ^ 1, which has to be properly 
detected looking for the value of q making Hq (t) linearly 
dependent on t. This letter is devoted to providing the 
guidelines for this search. 

We shall focus our attention on the calculation of 
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Note that if ^{t) of Eq.(||) depended on X, the value 

Sq resulting from the joint use of Eqs.(|ll|) and (|^) 

would afford a simple recipe to determine the statistical 
average {Xq{x)) at q = Q. In principle, Sg(i, (5) depends 
on the cell size S. However, we plan to prove that if it 
is properly evaluated, this quantity turns out to be_inde- 
pendent oi 6. As done in the earlier work of Refs. 
we study the logistic map: 
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with the control parameter = 1.4011551 . . ., namely, at 
the threshold of transition to chaos. In this case the in- 
variant distribution is multifractal, and consequently, ex- 
pressed as a function of x, looks like a set of sharp peaks, 
which, in turn, through repeated zooming, reveal to con- 
sists of infinitely many other, sharper, peaks. This means 
that the direct evaluation of Eq.(p) is hard, since it is dif- 
ficult to ensure numerically that these fractal properties 
are reproduced at any arbitrarily small spatial scale. We 
have to look for a different approach. 

Let us replace the average over x with the average over 
the crowding power index a. In the long-time limit we 
obtain Pi 
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This equation rests on assuming dependence on the initial 
condition only through the power law index P{t, a) itself 
which, in fact, according to Anania and Politi Ref. [0, 
reads 
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We shall show with theoretical and numerical arguments 
that this relation yields Eq.(Q) for the exact value of Q. 
The symbol a denotes the crowding index corresponding 
to a given initial condition x, namely the position of the 
trajectory at t = 0, and the symbol ait) denotes the 
crowding index corresponding to the position of the same 
trajectory at a later time t > 0. According to Anania and 
Pohti [0 
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where k indicates the fc-th generation of the Feigenbaum 
attractor. 

Before proceeding, let us make an assumption which 
has the effect of accomplishing, within the non-extensive 
perspective, the Kolmogorov program of an entropy in- 
dependent of the size of the partition cells. First of all, 
let us rewrite Eq. ( [l3| ) in the following equivalent form: 

Egit) = [da eW^(/(")-«"+«-i)e^(«-i)/3("-n, (16) 
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Let assume now: 
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Under the plausible condition that the functions /(a) — 
qa + q—1 and /3(q;, V) are not divergent, this assumption 
has the nice effect of producing 
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At this stage we make another crucial step. This is sug- 
gested by the work of Hata, Horita and Mori . The 
idea is that of using Pia, V) as independent variable so 
as to write Eq.(pO[) either as: 



EgiV)= J d/3F(/3,y)e^(''-i)'^("'^). 
or under the equivalent form: 
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We follow Ref. ||l^ again and we adopt the asymptotic 
property 1 19|: 



p(/3,t) = t-^(«p(/3^0). 
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The numerical calculation of the function ipiP) is done 
with a criterion different from that adopted in Ref. . 
The authors of Ref. |jl^ fix a window of a given size t 
and move it along the sequence for the purpose of eval- 
uating the frequency of presence within this window of 
a given algebraic index f3. This means that they make 
an average over many different initial conditions. We, 
on the contrary, fix a given initial condition, and we in- 
crease the size of the window, the left border of which 
coincides with the initial time condition < = 0, whereas 
the right border, at the distance t from the former, runs 
over the whole range of observation times. This different 
criterion is dictated by the specific purpose of evaluating 
the quantity of Eq.(^2|) in a way compatible with using 
only one single trajectory, while apparently the authors 
of Ref. (Tsl do not feel the need of fitting this constraint. 
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FIG. 1. The distribution density P{l3,t) as a function of 
l3. The distribution on the left has been evaluated using as 
initial condition amin', the distribution on the right uses as 



initial condition a„ 



The time t has been set 2 < t < 2 



The initial condition chosen is a; = 1. The reason for 
this choice is widely discussed in Refs. ||-^. This is so 
because aix = 1) = amin, therefore ensuring the condi- 
tion of maximum expansion. In Fig. 1 we show that the 



choice of amin rather than ar, 



shifts the distribution 



PiP,n) from the right to the left, namely from a condi- 
tion close to that of Ref. [Q, to a condition favorable 
for the emergence of Q. We note that the /9-distribution 
does not drop to zero beyond the value /3 « 1.3, which, 
according to Eq.(^^ is the maximum possible value of 
the power index p. This is a consequence of the fact that 
the theoretical prescription of Eq.(15|) refers to the time 
asymptotic limit i — s- oo, whereas the numerical calcu- 
lation is carried out with an upper bound on time: The 
maximum value of time explored is in fact tmax = 2^^. 
It is expected that with the increase of the time upper 
bound the distribution tends to drop to zero for values 
of p larger than the maximum possible value. 
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The result of the corresponding numerical calculation 
is shown in Fig. 2. To make more evident that the central 
curve, with q 0.25, is that corresponding to the true Q, 
we adopt the same procedure as that used by the authors 
of Ref. [|. We have fitted the curves Hg{t) of Fig. 3 in 
the interval [ti, with the polynomial H{t) = a+bt+ct'^. 
We define R = |c|/6 as a measure of the deviation from 
the straight line. We expect that q = Q results in i? = 0. 
We choose h = 100 and t2 = 1000 for all q's. In the 
insert of Fig. 2 we show that R becomes virtually equal 
to zero for q = 0.25, which is very close to the value 
q = 0.24 found by the authors of Ref. g. 

The shift from the left to the right distribution shown 
in Fig.l is of fundamental importance to find the correct 
Q. Further evidence of this fact is obtained by using 
analytical arguments to evaluate the integral of Eq.(22). 
We proceed as follows. First, we fit the numerical data 
on ipiP) by means of the function 
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with P* = 1.35 ± 0.05. For t ^ cx) the resulting P(/3) 
becomes equivalent to a Dirac 6 function centered at p* = 
1.35 ± 0.05, thereby making straightforward to find 
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If we neglect the logarithm term, the entropy growth be- 
comes linear in time at Q = 0.259 . . . ± 0.02. A more 
accurate fitting procedure, taking the distribution asym- 
metry into account, was proved to produce virtually the 
same result. This provides a strong support to the con- 
clusion of the numerical results of Fig. 2. As already 
mentioned earlier, we expect that with increasing the 
time upper bound the /3-distribution will reach a max- 
imum at /3 = 1/amin — ^/cimax and will drop abrutly to 
zero for larger /3. Consequently, the resulting true Q is 
expected to coincide with that of Eq.(^. In conclusion, 
we are convinced that the slight discrepancy between our 
numerical result and the theoretical prediction of Refs. 
1^-^ is essentially due to the fact that the numerical ob- 
servation is carried out at finite times. 
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FIG. 2. The function H^itfoi Eq.(y) as a function of time 

for three different values of the entropic index q. The values of 

q, from the bottom to the top curve, are q = 0.35, 0.25, 0.15. 

The insert shows R vs q. The values of R have been multiplied 




The importance of this paper goes much beyond chek- 
ing the prediction of Ref. g]. The result obtained is 
equivalent to observing only one trajectory moving from 
the initial condition x — \. This central result is made 
possible by the use of the average over (3 suggested by 
the important work of Hata et al. ||l^ as well as by the 
result of Ref. @. The method of Ref. ||l2| proves to 
be an efficient way of expressing the dependence of the 
trajectory entropy on the sensitivity to the initial con- 
ditions. We are convinced that Eq.(||) can be regarded 
as the proper non-extensive generalization of the Pesin 
theorem. Consequently, under the assumption that the 
dependence on initial conditions is realized only through 
/3(i, a), the slope of the curve of Fig. 2, corresponding 
to q = Q = 0.25, is the genuine extensive KS entropy of 
this archetypical condition of weak chaos. 

We thank C. Tsallis for reading the draft of this paper 
and illuminating suggestions. 



[2: 

[s: 

[4: 
[s: 

[6] 
[7] 

[s: 

[9 
[10 

[11 

[12 

[13 
[14 

[15 

[16 

[17 
[18 

[19] 



J.R. Dorfman, An Introduction to Chaos in Nonequilib- 
rium Statistical Mechanics, Cambridge University Press, 
Cambridge (1999). 

J. P. Cornfeld, S.V. Fomin, Ya.G. Sinai, Ergodic Theory, 
Springer, New York (1982). 

C. Tsallis, A.R. Plastino and W.-M.Zheng, Chaos, Soli- 
tons & Fractals 8, 885 (1997). 

M.L. Lyra and C. Tsallis, Phys. Rev. Lett. 80, 53 (1998). 

U.M.S. Costa, M.L. Lyra, A.R. Plastino and C. Tsallis, 

Phys. Rev. E 56, 245 (1997). 

C. Tsallis, J. Stat. Phys. 52, 479 (1988). 

For un updated bibliography on the subject see 



http: / /tsallis. cat .cbpf.br/biblio.htm 



V.Latora, A.Rapisarda, C. Tsallis and M. Baranger, 



cond-mat/9906291 



by 10^ 



V. Latora and M. Baranger, Phys. Rev. Lett. 82, 520 
(1999). 

C. Beck, F. Schlogl, Thermodynamics of chaotic systems, 

Cambridge University Press, Cambridge (1993). 

M. Buiatti, P. Grigolini, L. PalateUa, Physica A 268, 214 

(1999). 

J. Yang, P. Grigolini, cond-mat/9906291, in press on 
Phys. Lett. A. 

P. Manneville, J. Phys.(Paris) 41, 1235 (1980). 

P. Gaspard, X.-J. Wang, Proc. Natl. Acad. Sci. USA, 85, 

4591 (1988). 

M. Buiatti, P. Grigolini, A. Montagnini, Phys. Rev. Lett. 
82, 3383 (1999). 

Ya.B. Pesin, Russian Mathematical Surveys (4) 32, 55 
(1977). 

G. Anania and A. Politi, Europhys. Lett. T, 119 (1988). 

H. Hata, T. Horita and H. Mori, Prog. Theor. Phys. 82, 
897 (1989). 

R.S. Ellis, Entropy, Large Deviations, and Statistical Me- 
chanics, Springer- Verlag, New York (1985). 



4 



